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A  DECISION  DIRECTED  PHASE  ESTIMATOR  MODEL 


INTRODUCTION 

The  objective  of  this  effort  was  to  develop  techniques  for  modeling 
digital  errors  which  occur  in  a  communication  system.  The  model  was  to  be 
computationally  efficient  for  applications  which  require  a  large  number  of 
replications  of  the  model  such  as  a  communication  network  analysis.  In  this 
effort,  an  important  component  of  a  digital  communication  system,  namely  a 
digital  phase-locked  loop  was  analyzed.  The  analysis  produced  a  stochastic 
model  of  the  digital  error  producing  process  associated  with  the  system.  A 
state  transition  probability  matrix  formulation  was  used  which  allowed  the 
calculation  of  a  variety  of  digital  error  performance  measures. 

In  this  Leport,  an  analysis  will  be  performed  of  a  digital  phase- 
locked  loop.  Using  standard  analytical  procedures  and  assumptions,  a  set 
of  discrete  conditonal  probability  density  functions  (pdf's)  for  a  phase 
state  variable  shall  be  developed.  This  will  then  form  the  basis  for  a 
state  transition  matrix  formulation  which  will  be  used  to  calculate  varir-iu 
probability  of  error  statistics. 

The  standard  cross-correlation  demodulator  described  in  the  lit¬ 
erature  implies  that  a  carrier  with  proper  phase  is  present  at  the  receiver. 
In  practice,  the  correct  phase  must  be  determined  at  the  receiver.  One 


popular  technique  for  performing  this  function  is  the  decision  directed 


phase  estimate.  It  finds  its  place  in  this  report  because  of  the  "memory" 
it  imparts  to  the  error  producing  process. 


There  are  many  underlying  causes  of  phase  noise  Chat 


mighc  be  hypothesized.  Here,  only  the  presence  of  additive 
white  Gaussian  noise  as  the  source  of  phase  noise  will  be 
assumed  and  an  analysis  will  be  performed  of  a  demodulator 
employing  a  phase-locked  loop.  For  clarity  of  presentation, 
a  binary  phase  shift  keyed  demodulator  shall  be  assumed. 
The  analysis  is  applicable  to  multiple  phase  demodulators  by 
using  an  appropriate  transformation  of  the  decision 
boundaries  as  described  Drevionsiv.  This  analysis  will 

prove  useful  for  any  demodulator  which  requires  a  phase 
reference  to  be  generated  at  the  receiver.  That  is,  as 
before,  the  dimensionality  of  the  system  is  being  reduced 

by  considering  only  the  phase  t r a n s f o r ma t i o n  technique  for 
the  received  signal  vector. 


SYSTEM  MODEL 

A  typical  implementation  of  a  decision  directed  phase 
estimator  is  shown  in  Figure  6.  Consistent  with  the 
notation  introduced  earlier,  the  transmitted  waveform, 

s(t),  along  with  the  additive  noise  waveform,  z(t),  is  shown 
at  the  input  to  the  demodulator.  The  additive  noise  is 
assumed  to  be  white  Gaussian  noise  with  a  two  sided  power 

spectral  density  of  Nq.  a  reference  sinusoidal  waveform  is 
used  to  generate  an  in-phase  and  quadrature  signal,  each  of 
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which  is  used  in  a  cross-correlation  integrator.  A  phase 
estimate,  3  ,  is  used  in  the  argument  of  each  of  these 
reference  waveforms.  An  accurate  phase  estimate  is  required 
to  assure  the  correct  phase  of  the  received  signal  vector, 
v,  which  will  ultimately  be  used  in  the  decision  process. 
This  properly  phased  reference  is  generated  by  a  voltage 
controlled  oscillator  (VCO).  The  control  voltage  for  this 
VCO  is  generated  using  the  phases  of  the  previous  received 
signal  vectors.  The  phase  of  the  received  signal  vector  at 
time  n  is  given  by 

n  )  *  t  a  n  *  (  Im  [  v  (  n  )  ]  /  R  e  [  v  (  n  )  )  ) 

Recall,  from  before,  Chat  due  to  the  viewpoint  being  used 
in  this  dissertation,  the  received  signal  vector  should 
ideally  equal  the  real  number  2aE.  Thus,  the  phase,  3, 
should  ideally  equal  zero. 

In  general,  the  phase  -reference,  3  (  n  )  ,  for  the 
demodulator  is  based  on  more  than  one  phase  measurement  of 
Che  received  signal  vector.  An  averaging  technique  is  used 
to  converge  to  the  expected  value  of  the  received  signal 
vector  phases.  Typically  an  analog  or  digital  loop  filter 
is  used  to  process  the  sequence  of  received  phases,  3(n),  in 
order  to  produce  a  phase  reference  or  estimate.  3(n). 

Here,  the  loop  filter  shall  be  modeled  as  a  digital 
first-order  network  as  shown  in  Figure  7.  This,  of  course, 


compuces  values  for  Che  first-order  difference  equation: 

3 ( nT  )  =  c  3 ( nl-T) ♦  3 ( nT ) 

The  transfer  function  for  the  system  shown  in  Figure  7  has 
been  derived  in  textbooks  such  as  Gold  [1969)  and  is  given 
by 

jwT  -1/2  -1 

H(e  )3(l+c-2c  coswT)  exp[jwT-jtan  ( s invT  /  (coswT-c  )  )  i 

(  4-  1  ) 

This  function  exhibits  a  periodic  frequency  selectivity 
in  terms  of  Che  frequency  variable  w  and  che  sampling  period 
T.  Note  chac  for  «T<  T,  chat  is,  for  frequencies  less  than 
one-half  che  sampling  rate,  or  in  this  case  the  bit  rate, 
the  loop  filter  behaves  as  a  low  pass  filter  which  is 
characterized  by  the  parameter  c.  As  such,  this  filter  can 
either  be  interpreted  as  a  digital  model  of  an  analog  loop 
filter  with  che  above  frequency  characteristic  or  as  an 
infinite  precision  model  of  a  digital  loop  filter 
implementation.  For  clarity,  attention  is  restricted  onlv 
to  a  first-order  digital  filter.  Extension  to  higher  order 
filters  can  be  carried  out  in  a  similar  manner. 

The  system  model  from  Figure  6  is  redrawn  in  Figure  3 

where  che  first-order  loop  filter  is  shown  explicitly  and 

che  usual  low  pass  notation  is  used.  Noce  chac  che  loop 

filter's  coefficient,  to  be  defined  short  lv  ,  is  now  c  ,  . _  , 

ij  3  n  a 

scales  che  phase  3.  This  digital  filter  would,  in  general, 
be  unstable  due  to  the  unity  feedback  gain.  However,  in  che 
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Figure  3 

DEMODULATOR  'JITH  DECISION  DIRECTED  PHASE  ESTIMATION 
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present  context ,  the  modulo  2  i  arithmetic  will  assure  that 
the  output  is  always  finite.  (For  example,  see  page  30, 
Lindsey  [1973).)  Furthermore,  the  distribution  of  the  input 
random  variables  will  produce  a  viable  model.  The  output  of 
the  c r o s s -c o r r e  1  a t  i  on  integrator  is  sampled  every  T  seconds 
and  the  loop  filter  is  a  digital  filter  making  a  computation 
every  T  seconds.  Again,  •$  is  the  digital  filter's  estimate 
of  the  correct  phase  reference,  which  is  dependent  on  past 
values  of  $  and  the  current  value  of  i.  Note  that  the  phase 
reference  estimate,  <2,  remains  constant  throughout  the 
integration  period  and  is  based  on  the  output  of  the  digital 
filter  up  to  the  previous  bit  time. 

DEVELOPMENT  OF  PHASE  ESTIMATION  MODEL 

In  this  section,  a  stochascic  model  for  a  demodulator 
with  a  phase-locked  loop  will  be  developed.  This  model  will 
be  based  on  the  phase  reference  estimate,  3.  It  will  oe 
shown  that  these  ohase  estimates  will  completely  determine 
che  state  of  the  system  model  shown  in  Figure  8. 

Recall  chat  the  system  model  assumes  additive  white 
Gaussian  noise.  Nevertheless,  the  usual  assumption  of 
independence  for  Che  sequence  of  received  signal  vectors, 
v(n),  cannot  be  made.  This  is  due  to  the  fact  that  the 
phase  of  the  received  signal  vector,  3(n),  is  a  function  not 
only  of  Che  independent  noise  sample?  but  is  also  a  function 
of  the  phase  estimate,  3(n-l).  As  shown  in  Figure  8,  these 


phase  estimates  are  a  function  of  previous  phase  estimates 
and  thus  independence  cannot  be  assumed.  It  will  prove 
useful  co  introduce  another  sequence  of  random  variables 
which  are  independent.  Define  i>  ( n  )  to  be  the  phase  of  the 
c r o s s - c o r r e 1  a c i o n  demodulator  output  with  a  perfect  phase 
reference  when  the  equivalent  low  pass  signal  r  (  t  )  is 
applied  co  the  input.  That  is,  if  the  phase  reference  is 
perfect,  and  the  loop  filter  is  open,  the  phase  sequence  at 
che  output  of  the  c r o s s -c o r r e 1  a t o r  shall  be  equal  co  j ( n  )  . 
The  distribution  of  J(n)  shall  be  determined  shortly.  It  is 
important  co  realize  at  chis  time  that  this  is  an 
independent  sequence  of  random  variables.  There  i s  no 
"memory"  introduced  by  che  white  Gaussian  noise  icself.  The 
memory  is  introduced  by  the  feedback.  nature  of  the 
implementation  of  a  practical  receiver  employing  a 
phase-locked  loop. 


Now  consider  che  closed  loop  implementation  in  Figure 


8  . 

In  general, 

,  the  phase  reference  3(n-l)  is  not 

perfect 

due 

to  che  noise, 

Ironically,  if  a 

perfect  received 

signal 

wave 

form,  i . e  .  , 

z ( n  )  *0  ,  arrived  by 

chance,  the  phase 

of  the 

received  signal  vector,  ^  (  n  )  ,  would  not,  in  general.  be 
zero.  As  a  result  of  che  previous  noisy  phase  estimates, 
the  phase  reference,  $ ( n -  1 )  ,  may  be  incorrect  .  Hence,  0 ( n  ) 
does  exhibit  memory  due  to  che  recursive  estimation  of  the 
phase  reference  $ ( n - l ) . 
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Now,  a  useful  representation  for  the  current  received 
signal  vector's  phase,  0(n),  is  presented  based  on  the 
previous  discussion.  Assume  that  ^(n)  is  composed  of  two 
terms  as  follows: 

4Xn)aJ(n)-#(n-l)  ;  sod  2i  (4-2) 

where  0 ( n )  is  the  aforementioned  sequence  of  independent 
random  variables  and  4 ( n  - 1  )  is  the  previous  phase  reference 
estimate. 

Now  consider  the  digital  implementation  of  the  loop 
filter  in  terms  of  the  sequence  of  random  variables,  J(n). 
The  loop  filter  is  a  first-order  recursive  filter  which 
converges  to  the  correct  phase  reference.  The  correct  phase 
reference  must  be  equal  to  the  expected  value  of  the 
sequence  of  the  random  input  phases  >  (  n  )  .  An  implementation 
of  the  first-order  loop  filter  using  the  random  sequence. 
Pin),  is  expressed  as 

^(n)»  c  > ( n  )  *  c  i(n-l)  (4-3) 

0  1 


The  coeffic 

ienc  c  controls  the 

r  o 1  1  -off 

f  requenev 

for 

the 

mo  del  of  the 

low  pass  filter,  as  i 

ndicated 

earlier 

i  n 

the 

di scission 

of  the  generic  first 

order  d  i 

g i t a  1  f Lite 

r  . 

The 

coefficient 

cq  is  a  normalization 

factor  which  assures 

that 
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each  phase  estimate  satisfies  -t<  $  (  n  )  <  n  .  Since  ✓  (  n  ) 
aisc  is  defined  in  the  region  (  -  ~r  ,  tt  ]  ,  the  following 
relationship  exists 

c  +  c  “  1  (4-4) 

0  1 


Now,  some 

very 

interesting  1 

i mi t i ng 

propertie 

s  of  the 

coefficients 

are 

cons 

idered.  From 

digital 

filtering 

theory  , 

it  is  known 

that 

a  s 

approaches 

1  ,  the 

roll-off  f 

requency 

for  the  low 

pass 

f  i  1 1 

er  approaches 

zero. 

Therefore  , 

in  this 

limiting  case, 

i  .  e  . 

.  c15,l  and  cQ  = 

0,  Equations  4-3 

and  4  -  2  , 

respectively,  yield 

^(n)*  ^(n-1)*  constant 

<t> ( n ) *  I>  (  n  )  -  constant 

That  is,  the  phase  reference  remains  constant.  It  follows 
that  if  the  initial  value  chosen  for  this  phase  reference  is 
correct  then  we  have  the  case  of  perfect  coherent 
demodulation  for  all  time.  Conversely,  as  c^  approaches 
zero,  the  phase  reference  is  determined  only  by  the  phase  of 
the  previous  received  signal  vector.  In  this  case,  c^=o  and 
Cq=*1,  and  Equations  4-3  and  4-2,  respectively,  yield 


<i  (  n  )  *  i>  (  n  ) 


\ 


-11- 


*(n)»  >  (  n  )  -  S(n-l) 


Ic  Chen  follows  Chat  if  Che  modulation  is  binary  phase  shifc 
keying  and  equals  zero,  the  results  obtained  here  are 

equivalent  co  differencial  phase  shift  keying. 

Equations  4-2,  4-3,  and  4-4  represent  the  defining 

equations  of  the  system  model  considered  in  this  chapter. 
Despite  the  fact  that  the  independent  random  phase  sequence 
i(n)  is  very  useful  for  a  theoretical  analysis,  it  does  not 
provide  the  most  efficient  implementation  for  the  system 
model.  A  more  efficient  implementation  was  included  in 
Figure  8.  This  implementation  readily  follows  from  the 
defining  equations.  Substituting  equation  4-2  into  4-3: 

~  -  * 

d  (  n  )  *  c  [  d  (  n  )  -*■  <tf(n-L)]+  c  d(n-l) 

0  1 

=  c  ^  (  n  )  ■*■  (c  +•  c  )  (  n  -  1  ) 

0  0  1 


■c^(n)+tf(n-l)  (4-5) 

0 

The  last  relation  results  from  Equation  4-4.  Equation  4-5 
is  Che  implementation  shown  in  Figure  8  which  obviously  is  a 
simpler  implementation  but  does  not  provide  sufficient 
insight  for  the  analysis  in  the  next  section. 
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EVALUATION  OF  CONDITIONAL  PHASE  DISTRIBUTIONS 

In  this  section,  the  distribution  of  the  phase 


estimates, 

$  (  n  )  ,  shall  be 

determined . 

This 

distribution 

shall 

be 

cond i t ioned  on 

the  previous 

phase 

estimate.  It 

will  be  shown  that  this  phase  estimate  is  sufficient  for 
completely  characterizing  the  system  model.  The  first  step 
is  to  determine  the  probability  density  function  of  ?(n). 
Let  X  and  Y  correspond  to  the  real  and  imaginary  components, 
respectively,  of  the  received  signal  vector  v(n).  As  usual, 
assume  the  waveform  corresponding  to  the  received  vector  2aE 
is  transmitted.  For  additive  white  Gaussian  noise,  it  is 
known  that  X  and  Y  are  distributed  according  to  the  joint 
Gaussian  pdf: 


2  2 

1  -  (  (  x  -  2  a  E  )  +  v  J  /  2  V 

p(x,y)  *  ---  e 
2*V 


where  V  =  2 EN  .  Next,  use  the  change  of  variables: 
0 


2  2  1/2 
R  *  (  X  Y  ) 

-  1 

t  *  tan  (Y/X) 


which  yields 
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2  2  2 

r  -(r  +  4a  E  -  4aEr  c  os'M/2V 

p  (  r  ,  j )  =• -  e 

2  ttV 


Integration  of  p  (  r  ,  )  over  che  range  of  r  yields  p  (  1>)  , 


inf 

p  ( $  )  *  f  p  (  r  ,  $  )  dr 
0 


1  -q 

■  -  -  e  (  1  + 

2  T 


1/2 

(4irq)  cos  } 


q 

e 


c  o  s  $  1 


1/2 
(  2  T  ) 


1/2  2 

(2q)  cos  5  -x  /  2 

f  e  dx) 

-inf 

(  4-6  ) 


2 

where  q  =  a  E/N  (See  Papculis  [1965],  page  501  for  a 

0 

detailed  derivation).  Note  that  the  probability  densicy 
function  of  S  is  in  terms  of  q  which  is  the  signal  to  noise 
ratio  at  the  receiver  input. 

Next,  as  motivation  for  the  work  in  the  remainder  of 
this  chapter,  some  observations  will  be  made  about  che  model 
up  to  this  point.  First  note  that  the  sequence  defined  by 
Equation  4-3  is  Ma r k o v i a n - l  ,  i.e., 


P<3(n)j*(n-l),3(n-2),  ...,»(0)> 

This  fact  makes 
representation  in 
This  powerful  tool 
s  ho  r  t 1 v  . 


P(|(n) | | ( n  -  1  )  >  (4-7) 

perfectly  suitable  for 
transition  probability  matrix, 
modeling  will  be  developed 


this  model 
a  state 
for  dynamic 
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Next,  note  Chat  Che  dynamic,  step-by-step,  behavior  of 
chis  state  variable,  3  (  n  )  ,  will  completely  determine  the 
error  modeling  process.  This  observation  is  justified  as 
follows:  An  error  occurs,  as  in  Example  3-2,  whenever 
3(n)  is  not  in  the  interval  (  -  */ 2  ,  */ 2  ]  .  But  by  virtue  of 
equacion  4-5,  the  error  decision  can  be  placed  in  terms  of 
Che  state  variable,  3(n)  .  No  error  occurs  provided  that 

-  tt/  2  <  (  $(  n  ) -$  (  n  -  1  )  /  c  Q  £  t/2 

or  , 

-irc0l  2  <  3(n)-3(n-l)  <  n  c  0  /  2  (4-8) 

As  a  result,  the  occurrence  of  an  error  is  dependent  on  the 
amount  of  change  in  3(n)  from  step  to  step.  The  dynamic  and 
average  properties  of  the  error  process  can  thus  be 
completely  determined  from  the  conditional  probability 
distribution  for  3(n).  The  next  task  in  chis  chapter,  then, 
is  to  compute  Che  conditional  probability  distributions  for 
chis  state  variable. 

To  compute  the  conditional  pdf,  f(<$(n)  |<3(n-l)  )  ,  it  is 
noted  from  Equation  4-3  that,  given  3(n-l),  3(n)  is  simply  a 
linear  function  of  s  (  n  )  .  The  pdf  of  i>  ( n  )  has  already  been 
computed  and  is  given  in  Equacion  4-6.  Therefore,  using 
standard  techniques, 
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f ($ (n ) | «(n-l  )  )  - 


p(Mn)) 


D  (c  >i(n)+  c  #  (  n  -  1  )  ) 
$  o  L 


$  (  n  )  » 


I  (  n  )  -  cl  ij(n-l) 


c 

0 


(1/c  )  p  (  (  3  (  n  )  -  c  )  / c  ) 

0  1  0 


(4-9) 


where  D  is  Che  firsc  derivative  with  respect  to  *>  and  p(.) 
$ 

is  the  probability  density  function  given  in  Equation  4-6. 

To  allow  a  computer  implementation  of  the  model,  the 
state  variable,  ?(n),  will  now  be  discretized.  The  range  of 
3(n)  is  divided  into  N  equal  regions.  It  will  be  assumed 
that  Che  discrete  random  variable  cakes  values  equal  to  Che 
midpoints  of  these  regions  denoted  by 

4  ,  4>  ,  ...  ,  &  .  ...  ,  & 

12  i  N 

The  probability  associated  with  each  of  these  N 
possibilities  is  given  by  integrating  the  continuous 
probability  density  functions  about  these  midpoints  as 


f  o  1  lows 


$  +  I 

i  + 1  i 


2 

P<*(n)-$  >-  /  p(l)da 

i 

$  -  I 

i  i  - 1 


2 


Similarly,  use  equation  4-9  to  compute  the  discrete 
conditional  transition  probabilities: 


P<*(n)-«  |*<n-lW  > 
j  i 


$  -$ 
j  +  1  j 


-1  2  -1  -1 
*  c  /  p  ( c  I  (  n  )  -  c  c 

0  $  0  01 
j  j-1 


2 


3  )  d  3  (  n  t 

i 

(4-10) 


where  the  pdf,  p(.)  is  given  in  equation  4-6. 


The  stochastic  error  model  for  the  phase-locked  loop  is 
now  completely  specified  in  terms  of  the  discrete 
conditional  transition  probabilities  of  the  state  variable 
%.  These  transition  probabilities  will  now  be  used  in  the 
state  transition  matrix  introduced  in  Chapter  3. 
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STATE  TRANSITION  MATRIX 


In  Chapter  3,  it  was  shown  how  a  sequence  of  Markov 
random  variables  of  the  discrete  type  could  be  conveniently 
represented  in  terms  of  a  state  probability  vector  and  a 
state  transition  probability  matrix.  In  that  chapter,  it 
was  shown  how  a  steady-state  state  probability  vector, 
P[inf),  could  be  obtained  from  the  single-step  state 

transition  probability  matrix,  TT .  An  examination  of 
Equation  3-7  shows  that  the  components  of  this  single-step 
transition  matrix  for  the  system  considered  here  are 
completely  determined  by  Equation  4-10.  In  anticipation  of 
the  work  in  this  chapter,  the  same  notation  was  used  in 
Section  3.4.  Thus,  the  model  developed  to  this  point  fits 
exactly  the  framework  of  the  matrix  methods  presented  in 
in  Section  3.4  and  all  results  are  applicable.  Therefore, 
P [ inf  ]  is  the  steady-state  state  probability  vector  for  the 
phase  reference  estimates. 

It  will  now  be  shown  how  this  steady-state  state 
probability  vector,  P ( i n f  J  ,  and  the  transition  matrix,  n, 
can  be  used  to  calculate  a  variety  of  average  error 
statistics.  It  has  been  shown  that  the  occurrence  of  an 
error  is  related  to  the  difference  between  the  current  phase 
estimate  and  the  previous  phase  estimate.  That  is,  the 
probability  of  a  symbol  error  is  given  by: 
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(4-11) 


P{error(n  ))  s  P  {  |  $  (  n  )  -  $  (  n  -  1  )  |  >  c  tt/2> 

0 

This  expression  can  be  placed  in  terms  of  the  N  discrete 
phase  possibilities  positioned  around  2  it  radians  with  equal 
spacing.  These  N  phase  possibilities  represent  different 
states  in  the  Markov  chain  formulation. 

P<e  rror  (n  )  }  *  P  {  ]  4S  (  n  )  -  $  (  n  -  1  )  |  >  c  N/4}  (4-12) 

0 

To  simplify  the  presentation,  it  is  assumed  that  Cq  is 
chosen  such  that  c^  n/4  is  an  integer.  A  multi-part  example 


will  be 

used 

t  0 

illustrate 

each 

part 

o  f 

the  current 

deve .opment  . 

Examp  1  e 

4.1  Consider  a 

binary 

phase 

-shift 

keyed 

demodulator 

as  shown 

in  Figure 

8  and 

an  additive 

white 

Gaussian  noise 

channel  . 

Let 

the 

loop 

c  o  e  f  f  i  c 

lent, 

c  0  ’  be 

e  q  ua 

1  to  0.5  and 

choose  N 

to  be 

equal  to 

8  .  A 

convenient 

sec 

of  discrete 

phase  estimates  and  the  associated  boundaries  for  che 
transition  probability  computations  in  Equation  4-10  is 
shown  in  Figure  9a.  Assume  that  the  phi  je  estimate  at  time 
n-1  is  in  state  3,  i.e., 


#( n -1 )  »  #  (4-13) 

3 


For  this  particular  set  of  circumstances,  the  probability  of 


(a)  STATE  BOUNDARIES;  N-8 


(b) ERROR  REGION  FOR  TIME  n  GIVEN  2 (a 


Figure  9 

STATE  REPRESENTATION  FOR  EXAMPLE  4.1 
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an  error  at  time  n  is  given  by 

P  {  e  r  r  o  r  (  n  )  |  3  (  n  -  1  )  =<?  >=  P{j$(n)  -  $  |  >  1} 

3  3 

8 

-  P<«(n)-J  ||(n-l)-<  }  +  L  P{|(n)-|  |*(n-l)-$  >  (4-14) 

1  3  i-5  i  3 

This  error  region  is  composed  of  five  segments  as  shown  in 
Figure  9b.  The  probability  of  falling  in  any  one  of  these 
five  segments  is  given  by  Equation  4-10. 

End  o  f  Example 

It  is  noted  that  the  probability  of  a  symbol  error 
defined  in  Equation  4-12  is  a  conditional  probability.  This 
is  a  result  of  the  fact  chat  this  probability  is  a  function 
of  the  random  variable,  |(n-l).  For  a  particular  value  of 
3(n-l),  (In  Example  4.1,  this  particular  value  was  3^)  the 
probability  of  an  error  is  a  number  calculated  using 
Equacion  4-10.  Express  the  probability  of  a  symbol  error 
given  a  particular  previous  phase  estimate  as  follows: 

P{error(n  )  |  $ ( n  - 1  ) *3  >■  P  {  |  3  (  n  )  -  $  j  >  c  N/4)  (4-15) 

i  i  0 

Equation  4-15  states  that  the  probability  of  a  symbol  error 
is  equal  to  the  probability  of  a  transition  to  a  scate  more 

chan  CqN/4  states  away.  Recall  chat  the  components  of  the 
previously  computed  single  step  transition  matrix,  n  =*  {  -t.  .} 
provide  the  probability  of  scate  transitions.  However.  the 
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computation  in  Equation  4-15  uses  the  elements  of  this 
single  step  transition  matrix  that  produce  a  transition  of 
more  than  CqN/4  states,  modulo  N.  For  a  convenient 
representation  of  these  elements,  define  the  set  S^(i)  as 
the  set  of  integers  j  for  each  i  such  that 

S  (  i  )  *  (j,  j  a  1  ,  .  .  ,  N  ;  such  that  | i —  j  |  >  c  N  /  4  :  modulo  N} 

j  0 

(4-16) 

Now  Equation  4-L5  can  be  expressed  in  terms  of  the 
components  of  the  single  step  transition  matrix 

Pierror (n  )  |  $ ( n  -  L  ) -$  > -  Z  n  (4-17) 

i  S  (  i  )  i  j 

j 

The  average  probability  of  a  symbol  error,  P  at  an 
arbitrary  time  n  is  given  by 

N 

P  -  Z  P(error(n)  ||(n-l)»$  >  P ( $ ( n  - 1) -  $  >  (4-18) 

e  i  - 1  i  i 

Substituting  the  components  of  the  steady  state  probability 
vector,  P [  i n  f  ]a  (p.(inf)},  for  the  distribution  of  the 
previous  phase  estimate  $ ( n  -  l  )  ,  and  the  resulrs  in  Equation 
4-17,  into  Equation  4-18  yields 
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N 

P  =  I  P  ( i n  £  )  [  r  t  1  (4-19) 

e  i  =  1  1  S  (  i  )  i  j 

j 


This  equation  relates  that  the  probability  of  error  is  equal 
to  the  sum  of  probabilities  of  transition  from  state  i  to  a 


state  more 

than 

cqN/4 

units 

away  , 

weighted  by  the 

probability  of 

being 

in  state 

i  . 

In  order 

to  express  this 

relationship 

in  a 

matrix 

form, 

define 

the  ma  t  r i x ,  S ,  as 

f  o  1  lows: 


(  1  for  all  | i  -  j  |  >  c  N  /  4 

S*  (s  >  where  s  *  <  0  (4-20) 

ij  ij  (  fl  otherwise 

Thus,  for  those  values  of  i  and  j  for  which  an  error  occurs, 
the  corresponding  element  of  the  matrix  is  equal  to  one. 


Example  4.1  Continued 


The  matrix  S  for  this  example  is  given  by 


0  0  111110 
0  0  0  1  1  l  1  1 
1  0  0  0  1  1  1  1 
5=*  1  1  0  0  0  1  1  1 

1  1  1  0  0  0  1  1 
1  1  1  1  0  0  0  1 
111110  0  0 
0  111110  0 


In  order  co  use  the  matrix,  S,  a  relatively  unorthodox 
product  operation,  referred  to  as  congruent  matrix 
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multiplication  is  used.  This  operation  does  not  follow  the 
rules  of  standard  matrix  algebra.  It  is  simply  a  device 
used  for  sifting  or  masking  some  of  the  components  of  a 
matrix.  It  is  a  term  by  term  product  of  two  identical  order 
matrices,  A  and  B,  defined  by: 

C*  A*B  ;  c  =•  a  b  ;  i,j«  1,..,N  (4-22) 

i  j  i  j  i  j 

Let  J  be  the  Nxl  column  vector  with  all  elements  equal  to  1. 
The  average  probability  of  error  derived  in  Equation  4-19 
can  now  be  expressed  in  matrix  form  as 

P  -  Pi  inf  ]  (  rt*S)  J  (4-23) 
e 

As  alluded  to  earlier,  the  major  focus  of  this 
dissertation  is  on  error  models  with  memory.  This  is 
certainly  the  case  for  the  phase-locked  loop  model  in  this 
chapter.  An  excellent  measure  of  the  error  dependence 
resulting  from  this  memory  is  the  average  probability  of  a 
bit  error  given  that  an  error  occurred  in  the  previous  bic 
time.  This  probability  will  be  calculated  next.  As  in 
Equation  4-18,  the  probability  of  an  error  at  an  arbitrary 
time  n  given  an  error  at  the  previous  time  n-l  is  given  by 


-2 


4 


P{arror(n  )  !  error(n-l)} 


e  e 


N 

Z  P { e r ro r ( n ) | $ ( n -  1 ) =  3  >  P(3(n-1)=  $  |error(n-l)> 

i  *1  i  i 

(4-24) 


The  last  expression  is  the  result  of  applying  the  discrete 
version  of  the  Chapman-Kolmogorov  equation  for  a  Markov-1 
process.  That  is,  Che  probability  of  error  at  time  n  is 
dependent  only  on  Che  previous  phase  estimate.  The  first 
probability  in  Equation  4-24  is  given  by  Equation  4-17.  The 
second  probability  requires  more  development.  It  is 
observed  that  this  is  the  probability  that  the  phase 
estimate  ends,  rather  Chan  begins,  at  when  an  error 
occurs.  This  is  just  the  inverse  of  Che  last  problem  solved 
in  which  a  phase  state  was  given  and  the  transition 
probability  matrix  was  used  to  compute  the  probability  of 
jumping  to  the  next  phase  state.  In  the  current  problem, 
the  probability  chat  the  system  was  in  each  state  of  the 
process  at  a  time  in  Che  past  is  calculated  given  that  its 
present  state  is  known.  This  problem  is  the  inference 
problem.  Before  Equation  4-24  can  be  evaluated,  some  theory 
concerning  these  phase  transitions  to  the  past  must  be 
developed.  In  this  development,  the  following  indices  shaLl 
be  used  for  each  of  the  phase  estimates  t  at  the  following 
corresponding  times: 
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.  d(n-2)=d  ,  i^(n-l)=gi  ,  ^(n)*^  ,  .  (4-25) 

k  L  j 

Lee 

•^k(n-l,n-2)=P<«(n-^)-4k|l(n-l)»^i> 

Then  , 

p  (n-2)  tt  (n-2,n-l) 


k  k  i 

(n-L  ,  n  -  2  )  *  - - -  (4-26) 

i  k  p  (  n  -  1  ) 

i 


As  usual,  Che  argument  is  dropped  for  the  single-step 
forward  and  backward  transition  probabilities.  Also,  assume 
that  the  process  is  in  the  steady  state  so  chat  Equation 
3-19  applies  and  the  limiting  state  probabilities  are 
substituted  in  Equation  4-26,  yielding 


p  (inf) 
k 

-  it  (4-27) 

ik  p  (inf)  ki 


Now  return  to  Equation  4-24.  Using  Bayes'  theorem  on 
che  second  conditional  discrete  probability  distribution: 


P<|(n-1)»#  |  e r r o r ( n - 1 ) > * 


P{  e  r  r  o  r  (  n  -  1  )  |  $  (  n  -  l  )  =#  >  P{$(n-1)*<?  > 

i  i 

P<error(n-l)> 

Considering  each  of  the  terms  on  the  right  hand 


(  4-28  ) 


side: 
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(4-29) 


P  <  #  (  n  -  1  )  =  |  }=  p  (inf) 


That  is,  chis  is  Che  steady  state  probability  distribution 
of  the  phase  estimates.  Also,  in  the  steady  state: 


N 

P{error(n-l)>*  P  =  Z  p  (inf) 

e  k  =  l  k 


L  IT 

S  (  k  )  ki 
i 


(4-30) 


Finally,  the  last  term: 

P(error(n-l)|3(n-l)»<$  >  *  Z  -p  (  n  -  L  ,  n  -  2  )  (4-31) 

i  S  (  i  )  i  k 

k 

That  is,  an  error  results  if  the  phase  jumped  "to"  the 
conditioned  value  "from"  a  phase  estimate  units  away. 

This  probability  uses  the  inverse  single  step  transition 
probability  discussed  earlier.  Therefore,  substituting 
first  Equation  4-26,  Chen  Equation  4-27  into  Equation  4-31, 
in  the  steady  state: 


* 


« 
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p  (  n  -  2  ) 
k 


P  <  e  r  r  o  r  (  n  -  1  )  j  $  (  n  -  l )  >* 

i 


Z  -  t  (  n  -  2  ,  n  -  I  ) 

S  (  i  )  p  (n-L)  ki 
k  i 


p  (  inf  ) 
k 

Z  . it  (4-32) 

S  (i)  p  (inf)  ki 
k  i 


Now,  substituting  Equations  4-17  and  4-32  into  Equation  4-24 
yields: 


N 


i  *  1 


P 


e 


e 


Z  tt  ]  (  Z 
S  (  i  )  i  j  S  (  i  ) 

j  k 


p  (inf) 
k 

- rr  ]  P  (inf) 

p(inf)  ki  i 
i 


N 

Z  p  (  i  n  f  )  Z  ir 
k-1  k  S  (k)  ki 


N 

'  [  Z  IT  ] 

i  ■  1  S  (  i  )  i  j 

j 


Z  p  (  i  n  f  )  tt 

S  (  i  )  k  ki 

k 


P 

e 


(  4-33  ) 


Thus,  the  average  probability  of  an  error  given  an  error  in 
the  previous  bit  has  been  calculated  using  a  transition 
probability  matrix  formulation.  Other  measures  for 
dependent  errors  can  be  computed  in  a  similar  fashion. 


\ 
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control,  battle  management  information  processing,  surveillance 
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sciences,  electromagnetics,  and  propagation,  and  electronic 
reliability  /maintainability  and  compatibility. 
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